Control and Simulation of a 6-DOF Biped Robot based on Twin Delayed Deep Deterministic Policy Gradient Algorithm

نویسندگان

چکیده

Objectives: To study an algorithm to control a bipedal robot walk so that it has gait close of human. It is known the Twin Delayed Deep Deterministic Policy Gradient (TD3) highly efficient with few changes compared popular — commonly used (DDPG) in continuous action space problem Reinforcement Learning. Methods: Different from usual sparse reward function model used, this study, combined and dense will be proposed. The application TD3 together proposed 6 degrees freedom presented. training process simulated Gazebo/Robot Operating System (ROS) environment. Finding: results show that, when choosing suitable for model, help learn faster achieve better results. biped can straight almost human-like gait. In paper, are also other algorithms. Novelty: Applying 6-DOF simulating robot’s Gazebo/ROS environment, ROS middleware real environment future. Keywords: TD3; robot; reinforcement learning; ROS; Gazebo

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Dynamic Control Algorithm for Biped Walking Based on Policy Gradient Fuzzy Reinforcement Learning

This paper presents a novel dynamic control approach to acquire biped walking of humanoid robots focussed on policy gradient reinforcement learning with fuzzy evaluative feedback . The proposed structure of controller involves two feedback loops: conventional computed torque controller including impact-force controller and reinforcement learning computed torque controller. Reinforcement learnin...

متن کامل

Deep Deterministic Policy Gradient for Urban Traffic Light Control

Traffic light timing optimization is still an active line of research despite the wealth of scientific literature on the topic, and the problem remains unsolved for any non-toy scenario. One of the key issues with traffic light optimization is the large scale of the input information that is available for the controlling agent, namely all the traffic data that is continually sampled by the traf...

متن کامل

Dynamic Control Algorithm for a Biped Robot

A not trivial problem in bipedal robot walking is the instability produced by violent transitions between the different walk phases. In this work a dynamic algorithm to control a biped robot is proposed. The algorithm is based on cubic polynomial interpolation of the initial conditions for the robot’s position, velocity and acceleration. This guarantee a constant velocity an a smooth transition...

متن کامل

Modeling and Simulation of a 6 DOF Robot

The purpose of this paper is to model and simulate a 6 DOF robotic system with revolute joints in order to optimize the motion law which results in uniform coating deposited by spray pyrolysis. The structure and the complexity of the robotized system are determined by the necessary movements in the spray pyrolysis process. The nozzle (end-effector of the robot manipulator) has two translations,...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Indian journal of science and technology

سال: 2021

ISSN: ['0974-5645', '0974-6846']

DOI: https://doi.org/10.17485/ijst/v14i30.1030